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Abstract. Conventionally, bright solitary wave solutions can be obtained in self- focusing 
nonlinear Schrodingcr equations with attractive self-interaction. However, when self- 
interaction becomes repulsive, it seems impossible to have bright solitary wave solu- 
tion. Here we show that there exists symbiotic bright solitary wave solution of coupled 
nonlinear Schrodingcr equations with repulsive self-interaction but strongly attractive 
interspecies interaction. For such coupled nonlinear Schrddinger equations in two and 
three dimensional domains, we prove the existence of least energy solutions and study the 
location and configuration of symbiotic bright solitons. We use Nehari's manifold to con- 
struct least energy solutions and derive their asymptotic behaviors by some techniques 
of singular perturbation problems. 

1. Introduction 

In this paper, we study symbiotic bright solitary wave solutions of two-component sys- 
tem of time-dependent nonlinear Schrddinger equations called Gross-Pitaevskii equations 
given by 

which models a binary mixture of Bose-Einstein condensates with two different hyperfine 
states called a double condensate. Here Q C ~R N (N < 3) is the domain for condensate 
dwelling, ipj's are corresponding condensate wave functions, h is the Planck constant 
divided by 2tt and m is atom mass. The constants Ujj ~ ajj, j = 1,2, and c7 12 ~ a^, 
where ajj is the intraspecies scattering length of the j-th hyperfine state and a i2 is the 
interspecies scattering length. Besides, Vj is the trapping potential for the j-th hyperfine 
state. In physics, the usual trapping potential is given by 

JV 

Vj(x) = s ^a j)k (x k - z j)k ) 2 for x = (xi, • • • , x N ) G Q,j = 1, 2 , 

k=l 

where dj tk > is the associated axial frequency, and Zj = (zj t i, • • • , %,jv) is the center of 
the trapping potential Vj. 

When the constant Ujj is negative and large enough, self-interaction of the j-th hyper- 
fine state is strongly attractive and the associated condensate tends to increase its den- 
sity at the centre of the trap potential in order to lower the interaction energy (cf. [3*2"]). 
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This may result in spikes and bright solitons which can be observed experimentally in 
three dimensional domain (cf. [H]). Conversely, when the constant Ujj becomes positive, 
self-interaction on the j-th hyperfme state turns into repulsion which cannot support 
the existence of bright solitons. To create bright solitons while each self-repulsive state 
cannot support a soliton by itself, the interspecies attraction may open a way to make 
two-component solitons called symbiotic bright solitons. Recently, symbiotic bright soli- 
tons in only one dimensional domain have been investigated as the interspecies scattering 
length <2i2 is negative and sufficiently large (cf. [2H])- However, in two and three dimen- 
sional domains, the existence of symbiotic bright solitons has not yet been proved. In 
this paper, we want to show the existence of such solitons by studying the least energy 
solutions of two-component system of nonlinear Schrodinger equations. 

To obtain symbiotic bright solitons in a double condensate, we may set ipi(x,t) = 
u(x) e lXlt , ip2(x,t) = v(x) e tX2t and use Feshbach resonance to let Uj/s, Ay's and fi^'s be 
very large quantities. By rescaling and some simple assumptions, the system (jl.lj) with 
very large Uj/s, X/s and Oj^'s is equivalent to the following singularly perturbed problem: 



where u and v are corresponding condensate amplitudes, e > is a small parameter, 
and (3 ~ — a± 2 7^ is a coupling constant. Here we may use the zero Dirichlet bound- 
ary condition which may come from ^3]. To study symbiotic bright solitons of double 
condensates, we consider two cases of the domain Q. One is to set Q as the entire space 
R N (N < 3). The other is to set Q bounded smooth domain in R . The constants 
fij ~ — Ujj < 0,j = 1,2, give repulsive self-interaction, and (3 ~ — a 12 > means at- 
tractive interaction of solutions u and v. Moreover, Vj > 0,j = 1,2 are the associated 
trapping potentials. 

Another motivation of studying the problem (jl.2j) may come from the formation of 
bright solitons in a mixture of a degenerate Fermi gas with a Bose-Einstein condensate 
in the presence of a sufficiently attractive boson-fermion interaction. Recently, there 
have been successful observations and associated experimental and theoretical studies of 
mixtures of a degenerate Fermi gas and a Bose-Einstein condensate (cf. (TO], [211 anc ^ 
[2*o]). Recently, the corresponding model has been given by 



ihd t <pf = -^Aiff + V F (x)<pf + g BF N B \<p B \ 2 <pf , x e SI, t > ,j = 1, • • • , N F , 



where N B and N F are the numbers, m B and m F are the mass of bosons and fermions, V B 
and V F are trap potentials, ip B and y^J's are wave functions of Bose-Einstein condensate 
and individual fermions, respectively. When the constant g B is positive i.e. repulsive 
self-interaction, and the constant g B p is negative and large enough enough i.e. strongly 
attractive interspecies interaction, bright solitons may appear in such a system. Using 



e 2 Au — Vi(x)u + /iiM 3 + I3uv 2 = in f2, 
e 2 Av — V 2 (x)v + fi 2 v 3 + (3u 2 v = in Q, 
u, v > in Q, 
u = v = on dQ, 



(1.2) 




(1.3) 
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the system (|1.3J) (cf. [H|), a novel scheme to realize bright solitons in one-dimensional 
atomic quantum gases (i.e. the domain Q is one dimensional) can be found. Here we 
want to study bright solitons in two and three-dimensional atomic quantum gases i.e. 
the domain Q is of two and three dimensional. As for the problem ([1.2)1 . we may set 
ip B = u(x) e tXl 1 1 'y/Ns, ff = Vj(x)e lX2t and suitable scales on Trig, Trip, Vbi Vf, 9b j 9bf 
and X/s. Then the system (jl.3)l can be transformed into 

e 2 Au - V x (x)u + /iiM 3 + (3u v ? = in fi, 

j = i 

* e 2 Av j -V 2 (x)v j +pu 2 v j = in Q, j = l,---,N F , ( L4 ) 
u, Vj > in f2, 
u = v = on dfl , 

which can be generalized as a singular perturbation problem given by 

e 2 Au - V\{x)u + fiiu 3 + (3u u| = in fi, 

< £ 2 Avj - V 2 (x)vj + [i 2 Vj + (3u 2 Vj = in Q, j — 1, ■ ■ • , m , 
w, f j > in f2, 
u = v — on <9f2 , 

v 

where /ij < 0, j = 1,2 are constants and m = Np G N. In particular, the problem (jl.5|) 
becomes the problem (jl.2)l as m — 1. 

In this paper, we study the asymptotic behavior of so-called least-energy solutions of 
the problem (jl.2j) which may give symbiotic bright solitons in two and three dimensional 
domains. By this, we mean 

(1) (u £ ,v E ) is a solution of (|1.2|) . 

(2) E £t ny 1 y 2 [u e ,v e ] < E et ny u y 3 [u,v] for any nontrivial solution (u,v) of (jl.2|) . 
where E^o^yjw, f] is the energy functional defined as follows: 

E e>nyuV2 [u,v] := y / lV'«| 2 + Y / f (1-6) 

for u,t) G i^Q (O). Actually, it is easy to generalize our results to the problem (|1.5|) for 
m G N. In the case of fl = H N , N = 2, 3, the least energy solution is also called ground 
state. In our previous papers (201, EI] an d [22], we studied the existence and asymptotics 
of least energy solutions when and /i 2 are positive constants. Hereafter, we study the 
case that both Hi and \xi are non-positive constants. 
As (3 < y/jii/12, it is obvious that 

/ [e 2 \ Vw| 2 + V lU 2 + e 2 \Vv\ 2 + V 2 v 2 ] = [ [2pu 2 v 2 + ^u A + /i 2 w 4 ] < (1.7) 
Jn Jn 
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for any (u, v) satisfying the problem (|1.2J) and hence u, v = 0. To get nontrivial solutions 
of the problem (jl.2|) . the assumption (3 > v //ii/i 2 is necessary. So throughout the paper, 
we assume that 

Vi < 0, /i 2 < 0, /3>V/^2- (1-8) 
To study least energy solutions, we define a Nehari manifold 



N(e,Q,V 1 ,V 2 ) = { (u,v) e H^Q) x ^(fi) 



J n [e 2 | v m| 2 + + e 2 \ v w| 2 + V 2 v z 

= J Q [2/3MV + /i 1 M 4 + /i 2 W 4 ] 



(1.9) 

Note that here, unlike j2D]-|22], the Nehari manifold N(e, fl, V±, V2) has only one con- 
straint. On such a manifold, we consider the minimization problem given by 

Ce,ny u v 2 --= , inf ^e.n.vi.vjw, «] • (1-10) 

u,-u>0, 
it , v ^ 

When £ = 1, Vj = Aj > 0,j = 1,2 i.e. constant trapping potentials and the domain 
tt = R N , the Euler-La grange equations of the problem (jl.lU|) are 

An - Aiw + /iiu 3 + (3uv 2 = in R", 

At; - A 2 t> + H2V 3 + (3u 2 v = in R^, (1.11) 
u, v — > as |y| — > +00. 

For such a problem, we have 

Theorem 1.1. Assume that 111. 8)} holds. Then Ci rjv^ ^ 2 is attained and hence the prob- 
lem 111.11)) admits a ground state solution which is radially symmetric and strictly decreas- 
ing. 

Now we consider the existence of ground state solutions for nonconstant trapping po- 
tentials. Namely, we consider the problem of coupled nonlinear Schrodinger equations 
given by 

e 2 Au - Vi(x)u + /iiu 3 + (3uv 2 = in R^, 

e 2 Av - V 2 {x)v + fi 2 v 3 + (3u 2 v = in (1.12) 
u, v —> as \y\ —> +00, 

where V/s satisfy 

0<6°= MVj(x)< lim VAx) = b°° < +00, 3 = 1,2. (1.13) 

J xeTL N \x\— »oo 7 

Then we have the following theorem on the existence of ground state solutions of the 
problem (JT7T2J). 

Theorem 1.2. If either bf + b 2 xi = +00 or 

c e,~R N y 1 y 2 < c e,R JV ,6f Q ,6g° (1-14) 

TTien c e RJv vi y 2 attained and hence the problem M.lty admits a ground state solution. 

Our next theorem is to show the asymptotic behavior of these ground state solutions as 
follows: 
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Theorem 1.3. Assume hl.ty) and 

inf c i,r n ,v 1 (x),v 2 (x) < Ci,-R N ,bf,bf (1-15) 

hold. Then 

(i) c e,n N .v 1 ,v 2 i s attained and the problem il.lfy) admits a ground state solution (u £ , v £ ). 

(ii) Let P £ and Gf be the unique local maximum points of u £ and v £ respectively. Let 
u £ (pz + ey) := U £ (y), v £ (Q £ + ey) := V £ (y). Then as e - 0, (U e , V £ ) - (U,V), 
where (U, V) satisfies hi. 11)) . Furthermore, 

\P e - Q £ \ 

►O, C ljR iVy l( p £)i y 2( Q e) — > mf C^ n N y l{x) y 2{x) . (1-16) 

Remark 1. In general, the condition hi. 15}) is difficult to check. However, if inf Vj(x) < 
lim Vj(x),j = 1,2, then hi. 19(1 is satisfied. 

\x\— >+oo 

Theorem 11.31 can be extended to general bounded domains. Firstly, we set Q as a 
bounded smooth domain and trapping potentials Vj's as constants X/s. Namely, we 
consider the following system 

e 2 Au — \i r a + /i^ 3 + j3uv 2 = in Q, 

e 2 Av-\ 2 v + fi 2 v 3 + l3u 2 v = in Q, (117) 
u, v > in Q, \ ■ ) 

u = v = on dQ . 

The asymptotic behavior of corresponding least energy solutions can be characterized by 

Theorem 1.4. For any (3 > ^JJTxfii and e sufficiently small, the problem \l.lTjj has a 

least energy solution (u £ ,v £ ). Let P £ and Q £ be the local maximum points of u £ and v £ , 
respectively. Then \P £ — Q £ \/e — > 0, 

d(P £ , dtt) -> max d(P, dQ), d(Q e , dQ) -»■ max d(P, dQ) , (1.18) 

and u £ (x),v £ (x) — > in Cj- oc (D\{P e ,Q e }). Furthermore, as e — > 0, (U e ,V e ) — > (U , Vq) 
which is a least- energy solution of il.ll]) . where 

U £ (y):= u £ (P £ + ey), V £ (y) := v £ (P £ + ey) . 

By Theorem II .41 we may generalize Theorem II. 31 to bounded smooth domains. The main 
idea may follow the proof of Corollary 2.7 in j22]- Moreover, by the same arguments of 
Theorems II. 1111.41 one may get similar results for the problem (jl.5|) . 

As /Ui,//2 > 0, the assumption (3 < j3o is essential in our previous works (cf. |20]-[22]) 
for the existence and the asymptotic behaviors of ground state (least energy) solutions, 
where < (3q < JJL{ /x 2 is a small constant. For larger /3's, results of ground and bound 
state solutions can be found in pQ, [B], and [33- O n the other hand, when the sign of 
fi/s becomes negative i.e. fix, ^ < 0, the assumption of /?'s can be changed as (5 > JJT\ JI2 
which is sufficient to prove the existence and the asymptotic behaviors of ground state 
solutions (see Theorem I1.1II1.4J1 . These are new results of two and three dimensional 
bright solitary wave solutions for negative /ij's. 

Conventionally, there has been a vast literature on the study of concentration phe- 
nomena for single singularly perturbed nonlinear Schrodinger equations with attractive 
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self-interaction. See 0, g], 0, 0, [23], [3D], |3D, 0, PI, [15], HE], [IE], [23], [3Z], 

[3%] . |3*o] and the references therein. In particular, a good survey can be found in J2E] 
and [27]. However, until now, there are only few papers working on systems of coupled 
nonlinear Schrddinger equations, especially for two and three dimensional Bose-Einstein 
condensates. This paper seems to be the first in showing rigorously that strong inter- 
species attraction may produce symbiotic bright solitons in two and three dimensional 
Bose-Einstein condensates even though self-interactions are repulsive. 

The organization of this paper is as follows: 
In Section 2, we extend the classical Nehari's manifold approach to a system of semilinear 
elliptic equations in order to find a least energy solution to the problem (|1.2|) . Hereafter, 
we need the condition (3 > JJi-y /x 2 for strong interspecies attraction. Using approximation 
argument and energy upper bound, we may show Theorem 11.11 11.21 and Theorem 11.31 in 
Section 3 and 4, respectively. In Section 5, we follow the same ideas of [20J to complete 
the proof of Theorem 11.41 

Throughout this paper, unless otherwise stated, the letter C will always denote various 
generic constants which are independent of e, for e sufficiently small. The constant a G 
(0, j4^) is a fixed small constant. 

Acknowledgments: The research of the first author is partially supported by a research 
Grant from NSC of Taiwan. The research of the second author is partially supported by 
an Earmarked Grant from RGC of Hong Kong. The authors also want to express their 
sincere thanks to the referee's suggestions. 



2. Nehari's Manifold Approach : Existence of a Least-Energy Solution 

to ([Ojl 

In this section, we use Nehari's manifold approach to obtain a least energy solution to 
(J1.2J) . Nehari's manifold approach has been used successfully in the study of single equa- 
tions. Conti et al [7] have used Nehari's manifold to study solutions of competing species 
systems which are related to an optimal partition problem in TV-dimensional domains. 
In our previous paper [20], we also used Nehari's manifold approach to find least energy 
solutions and symbiotic bright solitons. 

We consider the following minimization problem 

Ce,Q,Vx,V2 ■= inf E e ^, Vl y 2 [u,v] (2.1) 

u,v~>0, 

where N(e, Q, V±, Vg) and E £> Q >Vl y 2 are defined in Section 1. Note that, for iV < 3, by 
the compactness of Sobolev embedding Hq(Q) L 4 (Q), N(e, f2, Vf, V 2 ) and c £t n,v 1 ,v 2 are 
well-defined. Now we want to show that 

Theorem 2.1. Let Q be a smooth and bounded domain in H N ,N < 3. Suppose that 
(3 > v //ii/i 2 . Then for e sufficiently small, c £ ^y 1 y 2 can be attained by some (u E ,v £ ) G 
iV(£, f2, Vi, V2) satisfying 



C l£ N < I u 4 £ < C 2 e N , C l£ N < / vt < C 2 e N , (2.2) 
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where C\, C2 are two positive constants independent of e and Q. 
We first note that if (u, v) e N(e, Q, V 1 , V 2 ), then 



E e ,n,v 1 ,vA u i v ] 



V u\ 



[ V lU 2 + e 2 [ \x/v\ 2 + [ V 2 v 2 ) (2.3) 
Jn Jn Jn J 



fit u 4 + 2p «V+|i 2 / v 



Let (u n ,v n ) be a minimizing sequence. Then by Sobolev embedding Hq(Q) L q (Q) for 
1 < Q < jf^i we see that u n ~ > u e-, v n — * u e (up to a subsequence) for some functions 
u e > 0, v e > in L 4 (f2) and hence 



fit u A £ + 2(3 u 2 v 2 + H2 V 



Ce,n,V lt V 2 - 



By (|2.4|) and the weak lower semicontinuity of the H 1 norm, we have 



Vyu\ + e 2 I VU 



and 

s 2 



(2.4) 



(2.5) 



yu £ | 2 + / V^ + e 2 / |V^| 2 + / ^ £ 2 </ii / uj + 2[3 f u 2 £ v 2 + fi 2 [ v* . (2.6) 
Jn Jn Jn Jn Jn Jn 



Next we consider for t > 0, 



P(u,v)(t) = E £ ^y uV2 [Viu, Viv] . 



(2.7) 



Our first claim is 



Claim 1. If 2(3 J n u 2 v 2 + \i\ JqU 4 + fi 2 j n v A > 0, then (3(u,v){t) attains a unique maximum 
point to, where 



J n [e 2 \ v u\ 2 + V x u 2 + e 2 \ y v| 2 + ^ 
f n [2pu 2 v 2 + fi lU 4 + fi 2 v 4 } 



(2. 



Furthermore, (\/to~u, y/to~v) G iV(e, f2, Vi, V2) 
Proof. Since 



tt / lv«l +- / Vlu 2 + — / |yu| +- / 



-t 2 



/'I 



/'2 



then the proof follows by simple calculations. We omit the details here. 



□ 



By Claim 1 and proper choice of (u,v), it is easy to check that the Nehari manifold 
N(e, Q, V\, V 2 ) is nonempty. Our second claim is 

Claim 2. The inequalities of hold if (3 > JJJ^fTi- 
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Proof. We first prove the upper bound of c £j ny lt y 2 . Since (3 > ^/ii/12, there exists a^O 
such that 2(3a 2 + H\a + fi 2 > 0. In fact, we may set a = — ^ if fij < 0,j = 1, 2. For 
e sufficiently small, we choose a test function w such that support (w) C B £ (P) where 
P6fl. Let (u,v) = (aw,w). Then J n [2f3u 2 v 2 + ^u 4 + /j 2 v 4 } > 0. By Claim 1, there 
exists to > independent of e such that (y/toii, -Jt^v) G N(e, Q, Vi, V 2 ). Hence we obtain 



c E ,n, Vl ,v 2 < Ce N , (2.9) 

where C is a positive constant independent of e and Q. Combining ()2.9j) with (|2.3|) . we 
obtain that 

/ [e 2 | Vu £ \ 2 + 14 + ^ 2 |V^f| + V 2 v 2 ] < C 2 e N . (2.10) 
Jn 

For (|2.10p . we may rescale spatial variables by e and apply the standard Gagliardo- 
Nirenberg-Sobolev inequality in (cf. [H]). Consequently, 



u 4 £ <C 2 e N , vt<C 2 e N , (2.11) 
n Jn 



where C 2 is a positive constant independent of e and Q. 

For lower bound estimates, the definition of the manifold N(e, £1, V±, V 2 ) may give 



[e 2 \ Wu\ 2 + V x u l + e 2 \ W| + V 2 v ] < 2(3 / uV , 

for any (w, t>) G N(e, Q, Vi, V 2 ). On the other hand, as for (|2.11|) . we may rescale spatial 
variables by e and apply the standard Gagliardo-Nirenberg-Sobolev inequality in H N 
(cf. [TT]) to derive 

/ [e 2 \Vu\ 2 + V l u 2 +e 2 \Vv 2 \+V 2 v 2 ] > Ce N ' 2 \{ f u 4 ) 1 ' 2 + ( / v 4 ) 1 ' 2 ] > Ce N ' 2 { f u 2 v 2 ) 1 ' 2 
Jn L Jn Jn J Jn 

for any (w, v) G N(e, Q, V\, V 2 ), and hence we obtain that for any (u, v) G N(e, Q, Vi, V2), 
M^(0,0), 

/ u 2 v 2 >Ce N , (2.12) 
Jn 

where C is a positive constant independent of e and f2. Due to f n u 2 v 2 < (J n u 4 ) ^ 2 ( J Q t> 4 ) ^ 2 , 
(12.11}) and (|2.12|) may yield lower bound estimates J Q u 4 > C\S N and J Q v 4 > C\S , where 
C\ is a positive constant independent of e and Q. 

□ 

Finally we claim that 
Lemma 2.2. (u e ,v e ) is a least- energy solution of 

Proof. By Claim 2 and (J2.6|) . we have 2(3 J n u 2 v 2 + fii J n u 4 + \i 2 J n v 4 > 0. Moreover, by 
Claim 1, there exists t > such that (y/tou £ , y/toV £ ) G -/V(e, f2, Vi, V 2 ) i.e. 



£ 2 / |V^ £ | 2 + / V lU 2 £ +e 2 / |V'^| 2 + / V 2 v 2 = t 



m I u 4 £ + 2(3 / u e \ 2 + /i 2 / t; 4 
n Jn Jn 

(2.13) 
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Consequently, ()2.6|) and (|2.13j) may give 
On the other hand, 

E E ,U,V 1 ,V 2 [VtoU s , V*O u e] > Ce,n,V u V 2 



t < 1. 



tlx I u% + 2(3 / w> £ + fr V, 
n Jn 7o 
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/ii / u A £ + 2(3 I u 2 £ v 2 £ + tii \ v_ 



(2.14) 



(2.15) 



(2.16) 



Since t > 0, (EHoT) and (l2~Tol) imply that t„ > 1- Thus by (l2~TD . we obtain t„ = 1 and 
(« 6 , i> £ ) G f2, Vi, V 2 ). Therefore, (u 6 , u E ) attains the minimum c £ ^y 1 y 2 . 

Now we want to claim that (u £ ,v £ ) is a nontrivial solution of (jl.2j) . Since (u e ,v e ) 
is an energy minimizer on the Nehari manifold N(e,Q,Vi,V 2 ), there exists a Lagrange 
multiplier a such that 

V E e,n,v 1 ,v 2 K,v e ]+a\y G[u £ ,v £ ]= 0, (2.17) 

where 

G[u,v}= ! [e 2 \xju\ 2 + V lU 2 + e 2 \xjv\ 2 + V 2 v 2 }- [ [^u 4 + 2(3u 2 v 2 + /i 2 w 4 ] . (2.18) 



Acting (j2.17j) with (u E , v e ), and making use of the fact that (u £ , v £ ) G N(e, Q, V\, V2), we 
see that 

a / 2[e 2 | v m £ | 2 + + £ 2 | V v £ \ 2 + V 2 v 2 } -8a [fim 4 + 2(3u 2 e v 2 + /i 2 y 4 ] = , 
Jn Jn 

and 

a / [/iiw 4 + 2/3^2 + ^^4] = g _ 
in 

Since (« e , u e ) ^ (0, 0) and 

/ {tHut + 2(3u 2 v 2 £ + ti 2 v 4 } = [{e 2 \x7u £ \ 2 + V 1 u 2 £ + e 2 \x 7 v £ \ 2 + V 2 v 2 } > , 
Jn Jn 

then a = 0. This proves that 

V £! eAVi.Va[«e>vJ = 

and hence (u e , v £ ) is a critical point of E £ ^y 1 y 2 [u, v] and satisfies (|1.2|) . By Hopf boundary 
Lemma, it is easy to show that u £ > and t> £ > 0. Therefore, we may complete the proof 
of this Lemma and Theorem 12.11 

□ 



Another useful characterization of c £i ny u v 2 is given as follows: 
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Lemma 2.3. If (3 > y/fiifi 2 , then we have 

c £) n,Vi,v 2 = inf sup E £ ^y uV2 [Vtu, y/tv] (2.19) 

u,u€i/l(f2), u^O,v^O, t>0 
/ n [2/3u 2 u 2 + M1 u 4 + M2 « 4 ]>0 



inf 



J n [|Vu| 2 + V x u 2 + |Vtf + W 



«,«eHi(n), u^o.^o, ( f ' \2Bu 2 V 2 + UiM 4 + /i 2 W 4 l)2 

Proof. The last identity in (|2.19|) follows from simple calculations. To prove (J2.19|) . we 
denote the right hand side of ()2.19|) by m s . From Theorem 12.11 c Sj n,v 1> v 2 * s attained at 
(u £ ,v E ) G N(e, fi, Vi, V 2 ). Moreover, by Claim 1 in Theorem 12.11 E £j f l y l y 2 [y/tu £ , y/iv £ ] 
attains its maximum at t = 1. Hence 

™>e < CB,n,w,% = Ee,n,VuvA u s,Ve\ = sup £ E ,n,vi,y 2 [V^w £ , Viv e ] . (2.20) 

t>0 

On the other hand, fixate H$ (fi) such that w, t> > and J^p/Sw 2 -?; 2 + /ii-u 4 + /i2f 4 ] > 0. 
Let t be a critical point of j3( u ,v)(t). Then (y/tou, \/tov) E N(e, f2, Vi, V2), 

c e ,n,Fi,v 2 < ^ e ,n,vi,Va (v^o«, v^o^) < sup -E e ,n,Vi,v a [Viu, Viv] 

and hence c £ ^y 1 y 2 < m e . Therefore, we may complete the proof of this Lemma. 

□ 

3. Proofs of Theorem II. II and Theorem 11.21 

In this section, we prove Theorem 11.11 and Theorem 11.21 by approximation argument. 
Fix a ball Q = B^, where k is a large parameter tending to infinity. By Theorem 12. 1[ each 
c e ,B k ,v 1 ,v 2 1S attained by (u k ,Vk) a least energy solution of the following problem: 

e 2 Au(x) — Vi(x)u(x) + /Jiu 3 + f3uv 2 = in B k , 
e 2 Av(x) - V 2 {x)v(x) + fi 2 v 3 + f3u 2 v = in B k , (3.1) 
u, v > in Bk, u — v — on dB k . 

By examining the argument in the proof of Theorem 12.11 we may obtain the following 
estimates: 



C x e N < \ u\< C 2 s\ C x e N < / v% < C 2 e N , (3.2) 

JB h JB k 

where C\ and C 2 are positive constants independent of < e < 1 and k > 1. By the 
system (13. lj) and (|3.2jl . we may derive that 



f [e 2 \Vu k \ 2 + ^ lM 2 + e 2 |V^| 2 + V 2 v 2 k ] < C 3 e N 



(3.3) 



where C3 is a positive constant independent of < e < 1 and k > 1. We may extend 
each Mfc and equal to outside respectively. Then ()3.3|) may give 

I \ u k\ \m(R N ) + I l^fcl (fl-i(RJV) < C±e N / 2 , (3.4) 
where C 4 is a positive constant independent of < e < 1 and k > 1. 
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Now we study the asymptotic behavior of u k ,v k as k — > oo. Due to IJ3.4)) . we obtain 
that as k — » oo, — ^ u, — ^ u, where u, u > and u, v G ^(R^). Moreover, the 
standard elliptic regularity theorem may give that (u, v) is a solution of the system 

e 2 Au - Viu + /i!?2 3 + (3v 2 u =0 inR 1 , . , 

e 2 Av - V 2 v + fi 2 v 3 + pu 2 v =0 in R^ . ^ ' 

Then we have the following lemma, whose proof is exactly same as those of Theorem 3.3 
in [221 

Lemma 3.1. 

(a) As k -> oo, c eA y uV2 -> c £tR N :Vl y 2 , 

(b) If u ^ 0,v ^ 0, then (u, v) is a solution of M.lty) and attains c £jR Ny 1 y 2 , i.e. (u, v) 
is a ground state solution of M.lty) . 

It remains to show that u ^ 0, v ^ 0. Note that if u = 0, then w satisfies 

e 2 Av - V 2 v + fi 2 v 3 = . (3.6) 

Due to fi 2 < 0, it is obvious that v = 0. Therefore, we only need to exclude the case that 
u = v = 0. 

Suppose V(a?) = Ai and V 2 (x) = X 2 . Then by the Maximum Principle and Moving 
Plane Method, both u k and v k are radially symmetric, strictly decreasing and satisfy 

e 2 Au k - Aiw fc + fixul + (3u k vl = in B k , 
e 2 Av k - \ 2 v k + fi 2 vl + (3u 2 k v k = in _ . 

Uk = u k (r),v k = v k {r) > in B k , 
u = v = on dB k . 

Here we have used the fact that A.,- > 0, jij < , j — 1, 2 and /? > 0. Moreover, since the 
origin is the maximum point of u k and t^, then Atifc(O) , Aufc(0) < and u k (0) , Wfc(0) > 0. 
Hence by (|3.7|) . we have 

/?K(0)) 2 > -yUlK(O)) 2 + Al, P(u k (0)) 2 > -fl 2 (v k (0)) 2 + \ 2 . 

Consequently, as k — > +oo, 

P(vo(0)) 2 > -/ii(n (0)) 2 + A 1 > A 1; (3.8) 

f3(u (0)) 2 > -fi 2 (v (0)) 2 + \ 2 >\ 2 . 

Here we have used the fact that fij < and (u k ,v k ) — > (uq,vo) in Cf 0C (R N ). Therefore, 
(|3.8j) may imply that u ^ 0,v ^ and (u ,v ) G N(l, R N , Ai, A 2 ) is a minimizer of 

Cl,RiV,Ai,A2- 

On the other hand, any minimizer of c x r jv Ai A2 , called (f/o, Vb), must satisfy 

AU - XiUo + fiiU$ + f3U V 2 = in R", 
AV - \ 2 V + fi 2 V 3 + pU 2 V = in R", (3.9) 
U ,V >0,U ,V eH 1 (R N ). 

Due to /3 > 0, the problem ()3.9|) is of cooperative systems. By the moving plane method 
(cf. |2H]), {Uq, Vq) must be radially symmetric and strictly decreasing. This may complete 
the proof of Theorem 11.11 

To finish the proof of Theorem 11.21 we divide the proof into two cases as follows: 
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Case 1: either = oo or frf = oo 
Proof. In this case, we note that 

1 



^ JB h \ 



<C 3 e 



and 



1 



e 2 \Vu k \ 2 + V lU 2 k + e 2 \Vv k \ 2 + l^ 2 



Consequently, 



>C A e N ' 2 y y y x* fc 



N 



where C5, 6*6 are independent of e < 1, fc > 1. This gives 

/ [e 2 \ Vu k \ 2 + V x u\ + e 2 | Vv k \ 2 + V^ 2 ] < C 7 e". 

JB h 

By Sobolev's embedding (since N < 3), 



it 



<C 8 £ 



/B fc n{|x|>ij} 



mm Vi(x) 



Hence 



lB k n{\x\>R} 



4<[ 

\ J B k n{\x\>R} 



' min Vi(x) 

J!C|>-R 



"I 



1 



1/2 



kl>-R 



./B fc n{|a|>.R} 
1/2 



«2 



1/2 



By (JOJ) and (l3~T2~J) . we have 



C 



10 



B fc n{|x|<R} 
Thus if u k — ^ u, then IT > and 



mm V\(x) 



M>B 

/ ^ 4 > ( Ci - ; 6,10 



1^. 



Due to bf = +00, we may 
Consequently, f B u A > \C\e N and hence u 0. 



C10 



(3.10) 



(3.H) 



(3.12) 



(3.13) 



choose i? large enough such that Ci 

/ min Vi(a;) 
" ' \x\>R 



(3.14) 
> \C X . 

□ 
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Case 2: bf < +00, j = 1,2 
Proof. Suppose u = v = 0. Then 



Mfc ,t; fc ->0in CL(R")- 



Let M and R be such that 



\Vj{x)-bf\ < — for |x| > R 



(3.15) 



(3.16) 



Let Xr( x ) De a smooth cut-off function such that Xr( x ) — 1 f° r \ x \ < R, Xr( x ) = f° r 
Ixl > 2R. Now we set 



Then we have 



R^ 



life = « fc (l - Xb) , Ufc = Vfc(l-Xfl)- ( 3 - 17 ) 

\Vu k \ 2 =[ \Vu k \ 2 -2f Vu k -V{u kX R)+ I \V(u kXR )\ 2 , 
Jr n Jr n Jr n 



and 



lim 



/ \Vu kXR \ 2 )=0. 
Jr n J 



Now we denote o(l) as the terms that approach zero as k — * 00. Thus we can write 

/ |W fc | 2 =/ |Vu fc | 2 + o(l). (3.18) 
Vrjv Jr^ 



Similarly, 



/ |W fc | 2 =/ |V^.| 2 + o(l), / V lU l + o(l), [ V 2 V k = f V 2 vl + o(l) 

Jr n Jr n Jr n Jr n Jr n Jr n 

for all 2 < p < 6. Hence E £Ayi y 2 [u k ,v k ] = c £>Bk>Vl>V2 = E £>Bk>Vl>V;2 [u k ,v k ] + o(l). More- 
over, 



'R ; 



R ? 



[ £ 2 iv^i 2 +&r^+£ 2 iv^i 2 +6^] 

r 

[/ilM^ + 2/5u 2 U 2 + /i!^] 

r 

(b? - V^xM + [ (b? - V 2 (xM + 0(1) 
Jr n 



(3.19) 



=oQ+o(l), , = 1,2. 



Similarly, we have 



'R N 



[ [2/3ulvl + ^ui + ii 2 vi] + o(l)Ce N . (3.20) 
Jr n 
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Hence by (13. 19 J) , (|3.20J) and (J2.8[) of Claim 1 in Theorem 12.11 we see that the unique 
critical point t of the function E £ ^n b ^ h ^[\/tu k , \/tv k } satisfies 



which yields 



On the other hand, 



and then 



tUi 



It - II 



tv k 



OI M l+0(i: 



M 



^.Bfc.Vi.Va + O^ — ) + o(l) 



tu k ,y/tv k ) eN(e,R N ,b?,b^ 



E 



e,H n ,bf,bf 



till 



tv k 



> c 



e,n N ,b?>,b% 



0(1) 
0(1) 



(3.21) 



(3.22) 



(3.23) 



Consequently, c £iR iv < Cg^,^,^ + 0{~n) + Letting M — > +oo and fc — > +oo, 
we obtain c^r^oo^ < c £ ^Ny 1 y 2 which may contradict with ([1.140 . Therefore, we may 
complete the proof of Theorem 11.21 □ 



4. Proof of Theorem 11.31 

In this section, we study the asymptotic behavior of (u e ,v e ) as e — > 0. Firstly, the 
energy upper bound is stated as follows: 

Lemma 4.1. For (3 > and < e « \, 

c e ,R* Vi,v 2 < e N [ inf M Ci.R^.ViCxj.VaC*) + o(l)]. (4.1) 

PROOF. Fix a point x G R w . Let (Uq,Vo) be a minimizer of c^rw ^^) ^^^. We 
set u(x) = U (^ = ^),v(x) = V r ( £ ^ £a ) and then use ([2.1 9|) to compute the upper bound 
of c £ -RNy 1) y 3 . Due to c e R iv Xl ,x 2 = £ N Ci t u N ' the rest of the proof is simple and thus 
omitted. □ 

Let u £ (P £ ) = sup u £ (x) and v £ (Q e ) = sup v e (x). We want to claim that sup(|P e | + 

x£R N x£R N e>0 

\Q £ \) < +oo. To this end, we need to show that both u £ and v £ are uniformly bounded. 
In fact, as for the proof of ([3.11)1 . we have 



/ (uf + v q £ ) < ce N , 2<q<6. (4.2) 
Jr n 
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The equation of u £ gives 



e 2 Au £ = V\u e — H\u £ — I3u £ v 



> - (3v 2 u £ 



= — C(x)u £ in 
Let U £ (y) = u £ (ey), and C e (y) = C(ey). Then 

A£7 e + C B (y)f/ e > in R N , and C e e L^R^) 
By the subsolution estimate (Theorem 8.17 of [T2] ) 



IK 



1/2 



IC4 



(4.3) 



(4.4) 



where C > is independent of e. Hence by ()4.2|) and ()4.4p . we see that 1 1 Z7 e | j ^oo < C and 
hence < u £ < C. Similarly, we may obtain < v £ < C. 

Claim 3: If \P £ \ — > +oo, then < +oo. Suppose = +oo. Since P e is a local 
maximum point of u £ , then Au £ (P £ ) < 0. Hence by the equation of u £ , we may obtain 

V 1 (P £ )u £ (P £ ) - fnul(P £ ) - (3u £ (P £ )v 2 (P £ ) = e 2 Au £ (P £ ) < 0, 

which implies that 

V!(P £ ) </3v 2 (P £ ) <C, (4.5) 

and hence 

|P £ |<C . (4.6) 

Therefore, we may complete the proof of Claim 3. Moreover, we may also claim that 
bf < +oo. In fact, suppose bf = +oo. Set U e (y) := u £ (P £ + ey),V £ (y) := v £ (P £ 
Then U £ -> U in ^(R^) and V £ -> V in ^(R^), where (C/ , V ) satisfies 

AC/ - &r^o + t^iUo + PU V 2 = in R". 
Hence by (|4.5|l . we may obtain Vo(0) > 0, and then Vo ^ 0. This implies that 

1 



(4.7) 



c e,RA,Vi,V a 



4 



[e z [Vu^ + Vmi + e *\Vv e 



V 2 v 



> - I [e 2 \Vu £ \ 2 + V lU 2 £ + e 2 \Vv £ \ 2 + V 2 v 2 £ 

4 J\x\>R 



1 

> - 

~ 4 



\x\>R 



> Ce 



N 



inf Vzix) 

\x\>R 



which contradicts with (j4.1j) . Here we have used the hypothesis that frf = +oo. Thus 
we may assume that b^° < +oo and b™ < oo. As before, (U e ,V e ) converges to (U ,Vq) 
satisfying 

AU - b?U + HiUl + pU V 2 = 0, AV - b™V + ^V* + (3V U 2 = in R w . (4.8) 
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Then again Vq ^ since otherwise, (Uq, Vq) = (0, 0) which is impossible. Moreover, 

Ce,R», Vl ,v 2 = \f [e 2 \Vu e \ 2 + V l u 2 £ + e 2 \Vv £ \ 2 + V 2 v 2 £ ] 
4 Jrn 



> \ f [e^u E \ 2 + V lU 2 E + e 2 \Vv £ \ 2 + V, 

4 J\x\>R 

> e N - f {\VU \ 2 + b?U 2 + \VV \ 2 + b?V 2 } + o(e 

4 Jn N 



> £^[01,^,600,^0+0(1)] 

which may contradict with (|4.1jl . Therefore, we complete the proof of sup \P £ \ + \Q £ \ < 
+oo. 

Let (P £ ,Q £ ) - (P°,Q°). As before, (U £ ,V £ ) = (u £ (P £ + ey), v £ (P £ + ey)) - (tf ,V ), 
where (£/ ,Vo) satisfies 

AC/ - V^P )^ + ^t/ 3 + /3f/y 2 = in R N , 
AV - V 2 (P°)V + n 2 V 3 + pU 2 V = in . 

Then by the strong Maximum Principle, Uq, Vq > 0. Furthermore, we have 



Ce.R^.Vi,^ - c l,R JV ,yi(P°),V r 2 (P )- 



Hence by Lemma \4.1\ 



c i,n N ,v 1 (p°),v 2 (p ) - c i,r. n ,Vi(x),v 2 (x) 



i.e. c 1 , R iv,v 1 (po),y 2 (po) — inf c 1iR jv y^y^) . 

xSR 

It remains to show that ^ P ~® ■ — > 0. In fact, if ^ p ~^ I — > +oo, then similar arguments 
may give 



lime c £jR jv jVl y 2 > c 1)R jv i y 1 (po) ) y 2 ( P o) + c^^^o^^o) > 2 inf c^^y^y^) 

which is impossible. On the other hand, if ^ P ~® ■ — > c ^ 0, then Uq and Vo may have 
different maximum points. This may contradict with the fact that both Uq and Vq are 
radially symmetric and strictly decreasing. Thus ^ P ■ — > 0. The uniqueness of P e , Q e 
may follow from Claim 8 of |20j- Therefore, we may complete the proof of Theorem II. HI 

5. Proof of Theorem 11.41 

In this section, we follow the same ideas of j20j to prove Theorem 11.41 As for the proof 
of Lemma 4.2 in [20], the upper bound of c £ ^^ lt \ 2 is given by 

Lemma 5.1. For [3 > JJIifl^, 

Ce&MM — e \ c i,R ,Ai,a 2 + Ci e +c 2 e > , [o.l) 

where R E — - max d(P, dQ) and Cj 's are positive constants. 
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Furthermore, the asymptotic behavior of (w e , i> 6 )'s can be summarized as follows: 



Lemma 5.2. For s sufficiently small, u £ has only one local maximum point P £ and v £ 
has only one local maximum point Q £ such that 



d(P e ,dQ) 



+00, 



d(Q £ ,dn) 



+00, 



\Pe - Qe 



0. 



(5.2) 



see 

Let U £ (y) := u £ (P £ + ey), V £ (y) := (Q £ + ey). Then (U £ , V £ ) -> (U , V ), where (U , V ) 
is a least- energy solution of 111. 11]) . Moreover, 



s\\7u £ \ + \u £ \ < Ce-^ {1 - a)1 



£ \V v e\ + \v e \ < Ce~ 



(5.3) 



Ve{S) 



Now we want to complete the proof of Theorem 11.41 We may assume that, passing to 
a subsequence, that P £ (or Q £ ) — > x G 0. Thus 

d £ = d(P £ , dfl) — > d := d(x ,dfl), as e — > 0. 

Note that do may be zero. Given a > a small constant, we may choose d' > and 
er' > slightly smaller than a such that 

vol(5(xo, d' )) = vol(fi fl B(xo, do + a)) and c/q < <io + cr' • 

Besides, we may set % as a C°° cut-off function such that 

1 for < s < d £ + a' , 
for s > d e + cr , 

o<^ 6 <i, \i e \ <c. 

Let u e (a;) = u £ r] £ (\P £ — x\) and v E (x) = v £ r] £ (\Q £ — x\). Then we have 

lime"" / [2(3u 2 d 2 + ^uj + /i 2 5 4 ] = / [2(3U 2 V 2 + /i^ 4 + /i 2 V 4 ] > . (5.4) 

Hence 

/ [2pu 2 £ v 2 + /iiw 4 + /i 2 w 4 ] > , 
Jn 

as e sufficiently small. 

By the decay estimate ()5.3|) and Lemma \2. 31 we obtain that 

Ce,Q,Xi,X s > E £ ^\ li x 2 [tu £ ,tv £ \ 



> ^AAi.Aal^ti'J-e exp 



2VAi 



(4 



0" 



AT 

e exp 



for all t G [0, 2], where Cl = Q fl -B(x £ , d £ + cr) and x £ can be P £ or <5 e . Let R £ 
d' £ is chosen such that 

vol(E(0, <)) = vol(Q n B(s e , 4 + cr)). 
Using Schwartz's symmetrization, we have 



(Km? > / 

B(0,d' e ) Jn 



(5.5) 

(4 + cr' 

— , where 
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and then 



[2mmr + M«:r + > / wkk + - ^ + m\ > o . (5.6) 

B(o,d' s ) Jn 



Thus 

p£,B(0,^),Ai,A 2 [^*, iC*] < -^e,n,Ai,A 2 

[tu e ,tv e ], Vie [0,2]. 

Here we have used the fact that > 0. 

By (|5.6|) and Claim 1 of Theorem 12.11 there exists t* G (0, 2] such that 

E £ ,B(o,d' s )M,xAt*K^v*} > E £jB{0A)iXlM [tu* £ ,tv* £ ] , Vt > 0. 

Then by (Q and (|577|) . 

P £) B(0,4),Ai,A 2 



(5.7) 



< £ 



e,f2,Ai,A 2 



< c £; n,Ai,A 2 + £^ exp 



2VAi 



(4 + O 



jv 

e exp 



2a/A^ 



(4 + <y' 



Ee,B(04' e ),\iA 2 [ t * u *ei t * V *e} 

= Slip E £ , B ( 0A y XlM [tU*,tv*} 
t>0 

u,v>0, 
(u,u)eJV(l,fl e ,A 1 ,A 2 ) 



> ci,rw A1)A3 + c 3 exp 



2(1 + (x)v% 



(4 + o(l)) 



+e c 4 exp 



2(l + <r)v^ 



(4 + o(i)) 



where Cj's are positive constants. Here the last inequality may follow from Lemma 15.11 
and Theorem 4.1 of [213]. Thus 



N i 

C £ ,n,Ai,A 2 ^ 6 \ 



ci,RN Mt x 2 + c 3 exp 



(■ exp 



■ 2(1+CT)Vir (4 + o(i)) 



2(1+CT) ^ (4 + o(i)) 



J > 



(5. 



Combining the lower and upper bound of c et n,x u x 3 , we obtain 



c 3 exp 



< ci exp 



2(1 + o-)VA 



i(4 + o(l)) 



2(l-o-)VAi 



(do + o(l)) 



+c 4 exp 



-c 2 exp 



2(1 + 0-)^ 



(4 + o(l)) 



2(1-0-)^ 



(4 + o(i)) 



This then shows that d(P E , , dCl), d(Q £ , d£l) — > max d(P, 9fi) since |P £ — Q e | — »■ 0. 



□ 
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